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Abstract 

In this paper, we propose a novel lower dimensional representation of a 
shape sequence. The proposed dimension reduction is invertible and compu- 
tationally more efficient in comparison to other related works. Theoretically, 
the differential geometry tools such as moving frame and parallel transporta- 
tion are successfully adapted into the dimension reduction problem of high 
dimensional curves. Intuitively, instead of searching for a global flat sub- 
space for curve embedding, we deployed a sequence of local flat subspaces 
adaptive to the geometry of both of the curve and the manifold it lies on. 
In practice, the experimental results of the dimension reduction and recon- 
struction algorithms well illustrate the advantages of the proposed theoreti- 
cal innovation. 



1 Introduction 

For many pattern recognition problems, the feature space is nonlinear and of high 
dimensionality and nonlinearity, for example, face recognition, image classifica- 
tion and shape recognition. Many dimension reduction techniques yj are there- 
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fore naturally introduced to ease the modeling, computation and visualization of 
the feature space. Dimension reduction has been widely used with different vision 
techniques such as contour tracking [3J, face recognition [4J and object recogni- 
tion f2l. 

One of the key points of dimension reduction is how to represent the geometry 
of the original space in a lower dimensional space [|9l[T0l. Most of the previous 
dimension reduction research yj focuses on embedding the points in the original 
space into a lower dimensional space. Beyond the point-wise dimension reduc- 
tion, the dimension reduction for a sequence of points or an evolving curve in the 
original feature space is more important in applications where features of interest 
are time varying such as, face expression [|4]|, events indexing in video sequence 
as a shape process IfTTl and human activity as a shape sequence [3]. To the best of 
our knowledge, only a few works |l3l|2l address the problem of how to represent a 
curve in the original feature space in a lower dimensional space. 

The dimension reduction of high dimensional curves may be categorized into 
two classes. One is to reduce the whole curve space to a lower dimension as in 
Il3l [121 [131. The other one is to reduce a particular the curve to a corresponding 
lower dimensional curve as in |[2|. The drawback of the first one is the Euclidean 
assumption by using an approximation with a spline function. Moreover, as in ^ 
by directly applying PCA to the spline coefficients, the global dimension reduc- 
tion does not consider the intrinsic dimensionality of a particular high dimensional 
curve. A curve sequence like walking, for example, is much simpler than a danc- 
ing sequence. Thus the dynamics of walking might be represented in a much 
lower dimensional space in comparison to other complex activities. The second 
category of dimension reduction as in [|2||, considered the geometry of a partic- 
ular curve in the original space, which, due to the chosen implementation of the 
Whitney embedding theorem, is computationally heavy on account of the iterative 
subspace search. At the same time, there exists no invertible mapping from the 
embedding space to the original one, thus limiting its extension to a generative 
process. 

Motivated by the importance of a lower dimensional representation of a manifold- 
valued curve and the limitations of the current techniques, in this paper a novel 
dimension reduction of a shape manifold valued curve is proposed. In contrast 
with previous curve dimension reduction techniques [[3l|2l, the proposed method 
has the following advantages: 

1 . the dimension reduction is adaptive to the Riemannian geometry of a shape 
space. 
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2. the computation is linear in the length of the curve times the dimension of 
the shape space. 



3. with a proper dimensionality, there exists a reconstruction as a subspace 
parallel transport on a manifold. 

To introduce the idea of the proposed dimension reduction framework for the 
manifold valued curves, this paper follows the moving frame formulation in (611711. 
According to [|7l[6l|, every curve on a manifold may be represented by a differential 
equation. 



where, V{Xt) is a vector field on a manifold, and Zt is a curve in a Euclidean 
space. Under such representation, to introduce a lower dimensional representation 
of Xt, a method is proposed to find the optimal vector field V{Xt) such that: 

1. The sequence of V{Xt) is path dependent and uniquely determined by Xt 
and initial condition V{Xo) by a efficient computation. 

2. The resulting dZt from Xt and V{Xt) have a distribution that lies in a lower 
dimensional subspace. 

The first requirement on V{Xt) means that Xt can be represented by only the 
initial condition V{Xq),Xq and the embedded curve Zt. According to [6] such 
property yields the 1-1 correspondence between Xt and Zt. The second require- 
ment is more intuitive that among all the V{Xt) satisfied the first requirement, the 
optimal one is selected such that the variance of tangents is best represented in a 
subspace. 

The first requirement is satisfied by select V{Xt) that is a horizontal vector 
field [7 J defined by the Levi-Civita connection as in Section [Z2l with a metric 
induced to the shape manifold M from the ambient space. According to |l6l|71|, 
under a defined connection, for Xt E M and initial condition V{Xq), there exists 
a unique selection of moving frame V{Xt). Thus given V{Xq) the resulting curve 
in Euclidean space have one-one correspondence to Xt. The reason of using the 
Levi-Civita connection have two folds. The first one is that it is a non-flat connec- 
tion. In contrast to the other category: flat connection, it is path dependent. Such 
property is important for dimension reduction because it provides more adaptivity 
to the geometry of the path on the manifold. The second reason is that in com- 
parison with the general nonflat connections defined by a PDE on manifold, such 
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particular Levi-Civita connection in Section 12.21 is consistent with the metric of 
the shape manifold in [5] that this paper is based on, and is computationally more 
efficient for a known ambient space and normal space of the manifold, as is the 
case of our shape manifold. 

The second requirement is achieved by the subspace representation result- 
ing from maximizing the variance of the corresponding curve development dZ{t) 
with different choices of V{Xq). In theory, without knowing the initial condition 
V{Xo) the Levi-Civita connection only determines the vector field V{Xt) up to 
a group action within the fiber of the Frame bundle (the total space of frames of 
the tangent space of a manifold) [7J. Among different choices for V{Xt) along 
the fiber in the frame bundle, a optimal frame is selected such that the previously 
discussed second requirement is satisfied to make the resulted Zt better repre- 
sentable in a lower dimensional space. A V{Xo) = {xq, 61,62, - ■ ■ , 6dim{M)} is 
selected by carried out PC A of all the parallel transported tangents along Xtlet 
{61,62, - ■ ■ ,6l} are the eigenvectors corresponding to the L largest Eigenvalues 
in the PCA calculation. Then A subspace spanned by the subset {ci, 62, - ■ ■ , 6l} 
is constructed to better represent the variance of all the tangents along Xt in a 
lower dimensional space. 

To summarize, a curve in the shape manifold M is represented as 



where Vi{Xt) can be represented by L curves in and Zi{t) is represented by a 
curve in R^. Our proposed dimensional reduction achieves the following points, 

1 . a lower dimensional representation of curves on a manifold. 

2. The moving frame representation can be generated to a stochastic represen- 
tation of random process on a manifold. Thus the propose method can be 
well adapted to a generative modeling in a lower dimensional space. 

3. the computation is linear in the dimension of Xt. 

4. there exists a reconstruction from the lower dimensional representation to 
the original curve on the shape manifold. 

The rest of the paper is organized as following. Section [2] provide necessary 
background knowledge of shape manifolds and the geometric calculation on it. In 
Section|3]and|4l the dimension reduction framework is introduced, which includes 
the curve embedding and the curve reconstruction. 
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2 Preliminary 



In this section, we first introduce in Subsection 12.11 the shape manifold that the 
dimension reduction is based on. Then in Subsection 12.21 a fundamental moving 
frame representation of curves on manifold is briefly introduced. 

2.1 Shape Manifold 

According to lEl, a planar shape is a simple and closed curve in M^, 

a{s) : / ^ M^ (3) 

where an arc-length parameterization is adopted. A shape is represented by a di- 
rection index function 6{t). With such a parameterization, 6{s) may be associated 
to the shape by 

§^ = e^"«. (4) 

OS 

The ambient space of the manifold of is an affine space based on L^. Thus 

e G AijJ). (5) 

The restriction of a shape is that it must be a closed and simple curve, and 
invariant over rigid Euclidean transformations. The shape manifold M is defined 
by a level function cf) as 



(f){e) = ( / eds, I cos{e)ds, / sm{9)ds ) . (6) 
Jo Jo Jo J 



M = 0-i(7r,O,O). (7) 

One of the most important properties of M is that the tangent space TM is 
well defined. Such a property not only simplifies the analysis, but also makes the 
incremental computation possible, 

TeM = {f eV\f 1. span{l, cos(^), sin(^)}}. (8) 

In addition, an iterative projection is proposed in Q to project the point in 
ambient space back to the shape manifold M. The idea is that each time 9 is 
updated as ^ + dO, where d9 is orthogonal to the level set cp"^ {(j){6)) . The dO is 
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calculated as rf0~^((7r, 0, 0) — 0(6')). For the detailed form of the Jacobian of d(j), 
one could refer to [5 |. 

The problem of this manifold for our stochastic modeling is the infinite dimen- 
sion. The mapping of random process in [6J from a manifold to a flat space is only 
defined on a finite dimensional manifold. Therefore, a Fourier approximation of 
the shape manifold we discussed above is developed, such that the dimension is 
reduced to a finite number. 

2.2 Moving Frame Geometry 

Let Xt be a curve on a manifold M, then following the moving frame representa- 
tion [[8l, the tangent dXt of manifold valued curve Xt may be written as: 



where {Vi{Xt)}i=i^2,- 4im{M) is a frame of the tangent space at Xt, which is de- 
noted as Tx^M. Consequently dZt may be understood as a linear coefficient of 
dXt under the representation of V{Xt). Such moving frame representation is 
widely used in geometry studies of curves. For example in the Frenet theorem 
[[8l the geometry of curve is uniquely identified by the curvature of V{Xt) up 
to a rigid Euclidean transformation. Recently in computer graphics, a rotation 
minimizing moving frame [[T71 are developed to avoid the singularity of original 
moving frame used in Frenet theorem. 

In this paper, the moving frame representation is utilized for the similar pur- 
pose of representing a curve on a manifold. In contrast to the previous designs 
of moving frame, in this paper we elaborate to propose a adaptive moving frame 
to represent a high dimensional curve in a lower dimensional space. Vector field 
V{X(t)) are developed as a sequence of parallel frames along Xt. The parallelism 
is defined under a Levi-Civita connection. The advantages of such innovation are 
briefly introduced in the following: 

1. Once V{Xt) are parallel according to the curve development theory in [l6l, 
Xt can be represented uniquely as (Xq, Vq, Zt). Such property yields the 
invertibility of the proposed dimension reduction of Xt. In other words, 
by the representative curve Zt in a lower dimensional space, Xt can be 
reconstructed when the initial conditions {Xq, Vq) are available. 

2. Under Levi-Civita connection, the parallel frames are calculated according 
to metric of the manifold M. Such property implies that the shape of Zt will 




(9) 
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reflect well the shape of Xt on M. For example, if Xf is a geodesic curve, 
then in the proposed method Zt will be a straight line in Euclidean space 

3. The particular shape manifold [5 J we adopted in this paper have a known 
tangent and normal space in the ambient space which greatly simplified the 
calculation of the moving frames under Levi-Civita connection. 

The Levi-Civita connection may be viewed as the Christoffel Symbol T that 
defines the directional derivative in M. 

D9.,dx, = Y,^l^9xk (10) 

k 

where Xj is the coordinate function of an arbitrary point m in M. The tangents 
of M can be written as linear combination of {9xj}j=i 2, .. ,dim(M)- For example at 
Xq, Vi{XQ) = J2j ci]dxj and dX^ = J2j ^j^^j- Thus according to Equation (fTO|) , 
we can analytically calculate the derivative of Vi{Xt) along Xt in direction dXt, 
which is denoted as Daxt{Vi{Xt)). V{X{t)) is parallel if Vi, 

St 

Dax,(y,(X,)) = 0. (11) 

St 

However in practical problems, it is usually impossible to chart the manifold. 
In other words, the coordinate functions x of M are usually unknown. In this pa- 
per, the shape manifold [Q we introduced in Section lZTI have some nice properties 
that allows us to calculate Daxj^ {yAXt)) in terms of a projection of Euclidean cal- 

St 

cuius in the ambient space onto the tangent space of the manifold M. 

De^{y,{Xt)) = Proj^^^j^ {^^T^) ' (12) 

where Vi is the vector representing Vi in the ambient space of M. Since the am- 
bient space is an affine space based on L^, thus Vi is calculable as a real vector in 
L^. The Proj j.^^^ is a mapping of vectors in onto the tangent space of M. 

3 Dimension Reduction 

The dynamics of some common human activities such as walking and running, 
are relatively simpler in comparison to a complex activity like dancing. Thus it is 
nature to speculate that the simple activity could be represented in a lower dimen- 
sional subspace on the shape manifold. To learn such sub-manifold, a dimension 
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reduction is proposed for a curve on a shape manifold. As described in the pre- 
vious section, first the horizontal vector field V{Xt) is defined by a Levi-Civita 
connection. Then Principle Component Analysis (PCA) is carried out to compute 
the optimal vector field V{Xt) = {xt, 61,62, - ■ ■ , cl} such that all the parallel 
transported tangents along Xt could be represented in a lower dimensional space. 

The shape sequence on a manifold M can be represented by a differential 
equation as, 

. dini{M) 

Xt = Xo+ V V,iXt)dZ,it), (13) 

where, V{Xt) is selected to be the horizontal vector field on a manifold and Zt is 
the curve development in a Euclidean space. Such a formulation have the property 
according to [17][6| that the resulting Zt is 1-1 corresponded to Xt with the initial 
condition V{Xq), Xq. 

The idea of the proposed dimension reduction is to reduce the dimension for 
a manifold valued curve Xt by learning a sequence of subspaces V{Xt) on the 
shape manifold M, such that the resulting dZt have a distribution that concentrate 
in a lower dimensional subspace. 

A Levi-Civita connection is adapted on the shape manifold according to the 
metric induce from the ambient space. According to the definition of covariant 
derivative under Levi-Civita connection as in Section 12. 2[ the horizontal vector 
field V{Xt) is the solution of the following differential equation. 

Wi,Dax^{V^iXt)) = 0, (14) 

at 

with initial condition {Xo,V{Xo)). 

The subspace moving frames V{Xt) for dimension reduction is constructed by 
select the optimal initial condition V^(Xo) = V^(^o) • First parallel transport all 
the tangents to the tangent space at Xq. With the moving frame formulation 
in Equation ([1311 . the parallel transportation results is a set r 

dim(M) 

r = {J2 V,{Xt)dZ,{t)}t=i,2,-,N (15) 

i=l 

According to |I3, the set r is invariant to the choice of V{Xo). Thus in the first 
step an arbitrary initial condition is assigned. 

Then Let the {ci, 62, 63, ■ ■ ■ , e^} be the eigenvectors that corresponding to the 
L largest eigenvalues of vectors in r. The optimal initial condition is constructed 
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as 

V^.(^o) = e,. (16) 

The solution V{Xt) of Equation (fT4|) with initial condition (Xq, V"(Xo)) is the 
moving frames we used to represent the Xj by the corresponding Zt in a lower 
dimensional space i?^ 

In the following, we provide the solution to the differential equation (IT4|) . 
According to Equation (IT2|) and normal space expression of the shape mani- 
fold M in Section I2.1[ the above equation can be solved as the following. Let 
{Biif) , B2{t) , B?){t)} be the orthogonalization of {1, cos(Xf), sm(Xt)}, which 
is the basis of normal space of the shape manifold M. Vi, 

^^i^*^ = aiSi(to) + a2B2{h) + a^B^{h). (17) 
ot 

In the numerical calculation of the Euclidean derivatives ^ ^'l^'-* j are imple- 
mented as follows. For a small enough h > 0, 



dV,{Xt)\ ViiXt+h)-Vi{X, 



dt / h 



(18) 



Substitute the Equation f fTSj) into the covariant derivative Equation ffTTj) . T^(Xt+/i) 
could be written as, 

y,(Xi+;,) = V^,(XO + a,B,{to) + a^B^^h) + 0353(^0)- (19) 

Since Vi{Xt+y^) G Tx^^^M, the parameter a, should satisfy that, 

< Vi{Xt) + a,B^{to) + a^B^ito) + a^B^it^), B^it^ + h)) >= 0, 

< Vi{Xt) + aiSi(to) + 02^2(^0) + 03^3 (to), ^2 (to + h) >= 0, 

and 

< ViiXt) + aiSi(to) + 02^2(^0) + 03^3(^0), ^3 (to + /i) >= 0. 
From the above three equations, we have, 

= -A-V, (20) 




where A = 

Bi(Xt)Bi(Xt+h) B2(Xt)Bi(Xt+h) B3(Xt)Bi(Xt+h) \ 

Si(Xt)B2(Xt+h) B2(Xt)B2(Xt+h) B3(Xt)B2(Xt+h) 

Bi(Xt)B3(Xt+h) B2(Xt)B3{Xt+h) B3(Xt)B3{Xt+h) J 

So the parameter could be solved in a linear fashion. Thus the shape sequence 
can be represented as follows, 

ft ^ _ 

Xt = Xo+ Yl y^iiXt)dZ,{t), (21) 

where dZi{s) =< Vi{Xt) > is a curve development in R^. 

Figure [21 illustrates the embedding of the shape sequence in Figure [T] The 
curvature of the embedded curve in R'^ in Figure [21 represent well the change of 
original shape sequence along time. 



A original sliape sequence on tlie sliape manifold 




Figure 1: The original shape sequence for activity: Running 



A embedding with a Levi-Civita connection 




r [ [ [ [ I 

Figure 2: The embedding of a shape sequence in Figure [H into R^ 
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In the following, the additional different activities from database [fT6l is con- 
sidered, such as Jumping, Siding, Skipping and Waving. The dimension reduction 
result in Figures [3I5I4I6[ also well visualized the evolution on the shape manifold 
M. 



(b) /\ embedding with the Levi — Civita connection 

1 (a) /\ original shape sequence on the shape manifold 




Figure 3: (a) The original shape sequence; (b) The embedding into i?^; (c) The 
reconstruction of the shape sequence from the embedding curve in R^. 



(b) A embedding with the Levi — Civita connection 

(a) A original shape sequence on the shape manifold 




Figure 4: (a) A original shape sequence; (b) The embedding into R^; (c) the 
reconstruction of the shape sequence from its corresponding embedding curve in 

R\ 
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(t>) A. embedding with the Levi — Civita connection 

(a) /\ original shape sequence on the shape manifold 




Figure 5: (a) A original shape sequence; (b) The embedding into li^; (c) The 
reconstruction of the shape sequence from its corresponding embedding curve in 

4 Reconstruction from the Lower Dimensional Rep- 
resentation 

As introduced in the previous sections, one of the claimed advantages of the pro- 
posed dimension reduction is that it is possible to generate the original shape se- 
quence from the dimension reduction results. Such an invertible property makes 
our lower dimensional shape process embedding a compelling way to learn the 
generative model of the shape sequence. 

Let Z(t) be the embedded shape process in i?^. A approximation of the origi- 
nal sequence on the shape manifold M may be generated by the following differ- 
ential equation: 

/"* ^ _ 

Xt = Xo+ Yl V^iXo)dZ,it) (22) 

where the horizontal vector field Vi{Xt)) is generated uniquely by the differ- 
ential equation [14] with the initial frame Xq, Vi{XQ). 

Numerically Equation fl22|) is implemented as a difference function, 

L 

Xk = fiXk^i) + J2 Vr{X^)dZ;{k - 1)) (23) 

i=l 
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A. embedding with the Levi — Civita connection 

(a) /\ original shape sequence on the shape manifold 




Figure 6: (a) A original shape sequence; (b) The embedding into li^; (c) The 
reconstruction of the shape sequence from its corresponding embedding curve in 

R\ 

where / is the iterative projection from the ambient space to the shape mani- 
fold as in [5], which is also briefly introduced in Section [XT] 

Figure |7]illustrates the reconstruction result of the shape sequence of activity: 
running. The reconstruction is from the embedding curve Z(t) E and the 
initial condition Xq, Vi(Xo) to the shape manifold M. 

The Figure |7] demonstrates that the reconstruction approximates well the orig- 
inal shape sequence. More reconstruction results of the shape sequence of other 
human activities are shown in Figures [3 15 14I6I 

5 Conclusion 

Dimension reduction of points on a high dimensional manifold is well studied in 
the past decades. Only a few works, however, address the problem of dimension 
reduction of curves on a manifold. In this paper a novel dimension reduction 
technology is proposed for shape dynamics with the following advantages that, as 
far as we know, no previous work has ever achieved: 

1. The subspace is learned nonlinearly according to the geometry of the un- 
derlying manifold. 

2. The computation is linear in the size of data. 

3. There exists an efficient reconstruction from the lower dimensional repre- 
sentation to the original curve on a shape manifold. 
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(a) A original shape sequence on the shape manifold 




(b) A reconstruction of the original shape sequence 
from the embedding in R3 




Figure 7: The reconstruction result for original sequence in Figure [T] with embed- 
ding result in Figure |2l 

4. The proposed dimension reduction technique provides both analytical and 
practical foundations for generative modeling of shape dynamics. 

This work also first apply the differential geometry tools such as moving frame 
representation and Levi-Civita connection to dimension reduction of curves on a 
manifold. It provides a new perspective on the dimension reduction with a moving 
frame formulation to naturally characterize the nonlinear features of a manifold 
valued dynamics in a linear subspace. 
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